What do post-editors correct? A fine-grained analysis of SMT and NMT errors
نویسندگان
چکیده
The recent improvements in neural MT (NMT) have driven a shift from statistical (SMT) to NMT. However, assess the usefulness of models for post-editing (PE) and detailed insight output they produce, we need analyse most frequent errors how affect task. We present pilot study fine-grained analysis based on post-editors corrections an English Spanish medical text translated with SMT use MQM taxonomy compare two categorized classification produced. Even though results show great variation among post-editors’ corrections, this language combination fewer are corrected by NMT output. also produces accuracy that less critical.
منابع مشابه
SMT reranked NMT
System architecture, experimental settings and experimental results of the EHR team for the WAT2017 tasks are described. We participate in three tasks: JPCen-ja, JPCzhja and JPCko-ja. Although the basic architecture of our system is NMT, reranking technique is conducted using SMT results. One of the major drawback of NMT is under-translation and over-translation. On the other hand, SMT infreque...
متن کاملa comparative move analysis of the introduction sections of ma theses by iranian and native post-graduate students
since esp received universal attention to smooth the path for academic studies and productions, a great deal of research and studies have been directed towards this area. swales’ (1990) model of ra introduction move analysis has served a pioneering role of guiding many relevant studies and has proven to be productive in terms of helpful guidelines that are the outcome of voluminous productions ...
15 صفحه اولa phonological contrastive analysis of kurdish and english
deposite the different criticisms on contrastive analysis it has been proved that the results of it(when processed)can be usuful in a tefl environment,specially at the level of phonology.this study is an attempt to compare and contrast the sound systems of kurdish and english for pedagogical aims. the consonants,vowels,stress and intonation of the twolanguages are described by the same model-ta...
15 صفحه اولNMT or SMT: Case Study of a Narrow-domain English-Latvian Post-editing Project
The recent technological shift in machine translation from statistical machine translation (SMT) to neural machine translation (NMT) raises the question of the strengths and weaknesses of NMT. In this paper, we present an analysis of NMT and SMT systems’ outputs from narrow domain English-Latvian MT systems that were trained on a rather small amount of data. We analyze post-edits produced by pr...
متن کاملOn the origin of errors: A fine-grained analysis of MT and PE errors and their relationship
In order to improve the symbiosis between machine translation (MT) system and post-editor, it is not enough to know that the output of one system is better than the output of another system. A fine-grained error analysis is needed to provide information on the type and location of errors occurring in MT and the corresponding errors occurring after post-editing (PE). This article reports on a fi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Revista Tradumàtica
سال: 2021
ISSN: ['1578-7559']
DOI: https://doi.org/10.5565/rev/tradumatica.286